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Traffic and Geometry Modeling with Sensor Networks 
Field of the Invention 

[01] The invention relates generally to sensor networks, and in particular to 
modeling traffic of objects with sensor networks and modeling geometries of 
sensor networks. 

Background of the Invention 

[02] Users of an environment, be it enclosed buildings, open spaces, or 
urban and rural roads, dynamically generate pattems of movement as the 
users move around in the environment. Users can be people, vehicles, or 
other mobile objects. 

[03] However, most automated systems for such environments, such as 
heating, cooling, lighting, elevator, security, traffic control systems, do not 
consider pattems of movement to dynamically adjust their operation for the 
users, e.g., building occupants, vehicles, or other mobile objects. 

[04] At most, elevator systems may have a pre-programmed schedule that 
favors up-traffic in momings, and down-traffic in the late afternoons. 
Similarly, HVAC systems may have different pre-programmed day-time and 
night-time operational settings. Traffic lights can also be preprogrammed. 
There are some devices, such as automated appUances that include sensors 
that respond to local movement. However, most systems are generally 
insensitive to large scale pattems of movement in the environment. 
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[05] It is desired to place a sensor network in an environment so that 
patterns of movement, i.e. traffic flow, of users in the environment can be 
determined. In addition, it is desired to predict future activities of the users 
based on known pattems of users. 

[06] Sensor networks, static and ad-hoc, are well known. It is preferred to 
use an ad-hoc sensor network. This makes it easy to relocate sensors as 
configurations of the environment, and pattems of usage change over time. 
Thus, the sensors can be adapted to current or future pattems of usage. 

[07] However, in either case, to make data acquired by the sensors useful 
for location specific analysis, it is necessary to determine a geometry of the 
sensors with respect to the environment. The geometry defines the spatial 
relationship between the sensors. It is desired to do this automatically and 
passively with just the sensors themselves. 

[08] Nissanka, et al., 'The cricket location-support system,'' Proc. of the 
Sixth Annual ACM International Conference on Mobile Computing and 
Networking, August 2000, describe a sensor network that times ultrasonic 
signals to determine locations of sensors. That is an active system that uses 
specialized components and processing. Other similar techniques based on 
RF signals are described by LaMarcal, et al., "Plantcare: An investigation in 
practical ubiquitous systems," Fourth Intemational Conference on 
Ubiquitous Computing, 2002, and Sahinoglu, "Location Estimation in 
Partially Synchronized Networks, U.S. Patent Application Sn. 09/649,759, 
filed on August 26 2003. Those systems are relatively complex. For many 
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applications, the resolution of the geometry of the sensors in the network 
does not warrant the cost and complexity involved with the prior art 
solutions. 

[09] Tracking data have been used in the prior art to determine patterns of 
movement, see W.E.L. Grimson, et al., "Using adaptive tracking to classify 
and monitor activities in a site," IEEE CVPR, June 1998, and Johnson, et al. 
"Learning the distribution of object trajectories for event recognition," 
Image and Vision Computing, 14(8), 1996. Those methods require the 
tracking and identification of specific objects in an environment over time. 

[010] The Aware Home project at Georgia Institute of Technology follows a 
similar idiom of attempting to understand behavior from relatively low- 
fidelity models, see Kidd, et al., "The aware home: A living laboratory for 
ubiquitous computing research," Proceedings of Second Intemational 
Workshop on Cooperative Buildings, October 1999. That work also requires 
tracking data of particular individual objects or users in order to determine 
pattem information in the environment. 

[Oil] In the prior art, event prediction in an environment has also required 
tracking data for particular objects, see U.S. Patent No. 6,587,781, issued to 
Feldman, et al., on July 1, 2003. That method requires voluminous traffic 
data acquired from a variety of sources be prioritized, filtered and controlled 
before any processing step can be applied to the data, and a geometry of the 
environment must be known. 
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[012] It is desired to model traffic flow with sensor networks. It is desired to 
do this passively and without having to identify events with specific objects. 
It is also desired to predict future activities based on the traffic flow. 
Furthermore, it is desired to determine geometries of sensor networks in a 
similar manner. 

Summary of the Invention 

[013] The method according to the invention models movement of users in 
an environment including sensors connected in a network. Events due to 
movement of the users are detected at the sensors and each event is labeled 
according to a particular sensor and time of the event. The events for each 
sensor are summed into a corresponding histogram time interval bin. A 
plurality of co-occurrence matrices are generated from the histograms 

T 

according toC,^ ^ = t^H^^Hj^^^ , where / and j represent each possible pair of 

sensors, S represent time-off-sets, Tis a total time for the detecting, t 
represents a particular time, and H represents the histogram time interval 
bins. 

[014] For each possible pair of sensors, a distance between the pair of 
sensors is determined and the distances are mapped to a geometry of the 
sensors. 

[015] The co-occurrence matrices can be used to determine a geometry of 
the network, and for predicting future activities signaled by terminating 
events- 
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Brief Description of the Drawings 

[016] Figure 1 A is a block diagram of a sensor network that can use the 
invention; 

[017] Figure IB is a floor plan of a building with a sensor network that can 
use the invention; 

[018] Figure 2 is a flow diagram of the method for modeling sensor network 
geometries according to the invention; 

[019] Figure 3 is a histogram of detected events over time; 

[020] Figure 4 illustrates a comparison of sensor histograms at a time offset; 

[021] Figure 5 illustrates determining inter sensor distances from co- 
occurrence matrices; 

[022] Figure 6 is a flow diagram of the method for predicting future 
activities according to the invention; 

[023] Figure 7 compares time-offsets between detected events and a 
terminating event; 

[024] Figure 8 illustrates summed probability distributions for predicting 
events; and 
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[025] Figure 9 is a ROC curve for results of the invention. 
Detailed Description of the Preferred Embodiments 
[026] Traffic Modeling 
[027] System Structure 

[028] Figure 1 A shows a system 100 for modeling traffic pattems in sensor 
networks, and for modeling the geometries of sensor networks according to 
the invention. The system 100 includes multiple sensors 110-116 in an 
environment 105. In an example application, the environment 105 is an 
office building, and the sensors are located in traffic areas such as hallways, 
lobbies, elevator waiting areas, break rooms, door ways, etc. 

[029] Figure 2B shows a floor plan of a building. Numbered circles indicate 
doorways 151, and filled circles indicate sensors 152. The doorways 153 
labeled 3 are elevator doors. The sensor 154 is an elevator hall call button. 

[030] The sensors 110-116 are connected to a controller 120. The 
connections can be wired or wireless, e.g., a IEEE- 1394 network. 

[031] In a preferred embodiment, the sensors have an extremely low 
resolution. For example, the sensors can only detect and report events using 
a single bit. 
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[032] Thus, the event is simply a Boolean event. Auxiliary information 
about direction of motion, velocity and identity of the detected user is not 
required. Also, there is no requirement to track users from one sensor to 
another sensor. 

[033] Example sensing modalities include infra-red, thermal, ultrasonic, 
light, radar, sonar, microwave, and pressure. Alternatively, the sensors can 
be simple electrical on-off switches. For example, turning on a light switch, 
pressing an elevator button, turning on an appliance can be a sensed event 
and indicative of a user in the environment near the sensor. 

[034] The sensors are oriented in a manner that enables the sensor to detect 
'events' occurring within a range of the sensor. For example, the sensors are 
mounted in a ceiling and are aligned with a longitudinal axis of a hallway. 

[035] As a characteristic, the sensors are low resolution, e.g., logical 0 
indicates no event, and logical 1 indicates a detected event. The sensors are 
globally distributed in the environment in an ad-hoc arbitrary pattern. The 
ranges of the sensors do not need to overlap. The range of the sensors can 
vary. The modality used to detect events in the environment can also vary. 

[036] The controller 120 includes a processor, memory, I/O interfaces and 
peripheral devices coupled to each other. The processor executes operating 
system and application programs that implement a geometry defining 
method according to the invention, as described in greater detail below with 
reference to Figure 2. 
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[038] The operation of tiie system 100 requires that users 101 move 102 
within the environment 105. The users can be people, vehicles, or other 
mobile objects. As the users move, the various sensors are activated, and 
'events' are detected at various times when the users approach the sensors. 

[039] The time off-sets between the events are used to estimate distances on 
the presumption that for a particular environment users move at a 
substantially consistent velocity. Thus, the geometry computed from the 
estimated distances is relatively accurate up to scale. However, it should be 
understood that the system does not require identification and tracking of 
individual users, and events detected by the system are not associated with 
any particular user. 

[040] Figure 2 shows a method 200 for automatically modeling based on 
events detected by the sensor network 100. Events 201 are detected 210 in 
the environment 105 by the sensors. Each event is labeled 220 according to 
the detecting sensor i, and time / of the event. The labeled event 221 is added 
230 to list 231 of detected events. The event list in a form of 0 = {0,1 }. 

Eu={0,l} (1) 

[041] A particular entry in the event list 231 is true (1) if and only if a 
motion event is detected by the i'^ sensor at time t. It should be noted that 
the events are Boolean, and indicate merely the presence of some kind of 
motion anywhere within range of the sensor with no indication of the 
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number of users, identities of the users, and direction and velocity of the 
motion, or any other secondary information. 

[042] Labeled events in the list are summed 240 into a histogram 300 by 
sensor for predetermine time intervals 'bins'. The histograms 300 are used to 
construct 250 co-occurrence matrices C /j, 251, as described below, where i 
and j are two sensors, and ^ is a time-offset between two events at sensor / 
and sensor j. The co-occurrence matrix is the basic model according to the 
invention for the detected events. The basic model can be used for a number 
of different applications. 

[043] Modeling Network Geometry 

[044] In one application the model is used to determine a geometry of the 
network. The geometry defines the spatial relationship between the sensors. 

[045] Inter-sensor distances dij 261 are estimated 260 from the co- 
occurrence matrices 251. The distances are estimated from the time-offsets, 
under the assumption that movement within the environment, over a large 
time period, is substantially consistent. The distances 261 are then mapped 
270 to a geometry 271 of the network of sensors. 

[046] Figure 3 shows an example histogram 300. Each bin 301-309 
represents a sum of all events detected by a particular sensor i during a 0.5 
second time interval. An event histogram entry Hij, is a total number of 
detected events from sensor i in time interval bin L 
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[047] The individual histogram entries are used to construct the co- 
occurrence matrices 251 by performing pair- wise comparisons of sensors / 
and j over a range of time offset 5 according to 

[048] c,M = i;//,,H,,,,, 

[049] where / and j are sensors being compared, and 5 is the offset, as 
shown in Figure 4 for a 1.5 second offset. 

[050] The Figure 5 compares total events of the co-occurrence matrices of 
sensor / with those of sensors j to p across a range of thirty second offsets. In 
Figure 5, time runs forward from left to right. The peaks 501-506 in the co- 
occurrence matrices reflect relative time-offsets between events detected at 
sensor / and each of sensors j-p. Over a long period of time, the peaks occur 
at average 'transit' times 511-516 it takes a significant number of the users 
to move from sensor / to next sensors j to p. 

[051] The transit times 51 1-516 are used to determine the distances d26l 
between the corresponding sensors. The distances are then mapped 270 to a 
scaled geometry 271 of the sensors. 

[052] In a preferred embodiment, we use multi-dimensional scaling (MDS) 
to map the distances to the geometry, see, e.g., Steyvers, "Multidimensional 
Scaling," Encyclopedia of Cognitive Science, Macmillan Reference Ltd. 
2002. Generally, MDS arranges objects, e.g., sensors, in a space with a 
predetermined number of dimensions, e.g., two under distance constraints. 
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[053] A 'stress' measure O can be used to evaluate a likelihood that a 
particular geometry conforms to the estimated distances according to 

[054] where /((/) is a non-metric, monotone transformation. The stress 
measure is used to rank-order the distances between the sensors. 

[055] Other similar measures can also be used such as measures that use a 
sum of squared deviations of the distances, or some monotone 
transformation of those distances. Generally, the smaller the stress measure, 
the likelier the estimated geometry reflects accurately the actual physical 
geometry as observed by the sensors. By applying an estimated velocity of 
the users, the geometry can be scaled to real- world dimensions. 

[056] The co-occurrences matrices according to the invention as described 
herein are used primarily to determine the geometry of the sensor network. 
However, it should be noted that the co-occurrences matrices capture a 
number of general global, as well as local, characteristics of the user 
movement within an environment. Therefore, the co-occurrence matrices 
can be used for other useful applications. 

[057] Activity Predication 

[058] As shown in Figure 6, the co-occurrence matrices can eilso be used to 
predict future activities 620. According to the invention, the beginning of an 
activity is signaled by a terminating event. For example, the events detected 
are users moving in the hall and foyer areas of Figure 1 A. The terminating 
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event is a hall call signaled by the user pushing an elevator button 154. The 
activity is scheduling an elevator car to serve the user. 

[059] The problem to be solved is to predict the scheduling activity of the 
elevator car prior to a user pressing the hall call button 154. If this activity 
can be predicted with a high level of confidence, then an elevator can be 
dispatched prior to the user pressing the call button. This saves time. 

[060] Given the co-occurrence matrices 251 for some period of time t<To 
in the past, the problem is to predict a specific activity before the terminating 
event associated with the activity is detected. This problem can be restated 
as the probability that a particular terminating event Eterm associated with the 
activity A will occur at a particular time given the co-occurrence matrices 
251. 

[061] One way to determine this probability is to sum 610 the probability 
distribution for each of the terminating event with respect to all other 
detected events. The co-occurrence matrices enable this by parameterizing 
the time-offsets between the events and the terminating event. 

[062] As shown in Figure 7, for the purpose of activity prediction, the time- 
offset in the co-occurrence matrices are interpreted as probability 
distributions. The probability distributions are analyzed by looking 
backwards in time from the terminating event associated with the activity to 
be predicted. 
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[063] In Figure 7, the terminating event is detected by sensor i at time te 
700. The probability distribution 710 indicates the likelihood that the events 
detected by sensor j are followed by the terminating event for some time- 
offsets 701 peaking at time 702. Similarly, events detected by sensor / are 
followed by the terminating event for time-offsets 703 as indicating by the 
distribution 711 peaking at time 704. 

[064] Figure 8 shows a normalized sum 800 of the distributions 710-71 1 
after time alignment. Essentially, the sum 800 models the likelihood that the 
terminating event will occur if an event is detected at sensor j at time off-set 
702 and another event is detected at sensor I at time-offset 704. This can be 
expressed mathematically as p{At, = 1| Eto, Eto-i, Eto-i, ...) = ^p(Et, I • 

setting the to > te and comparing the probability to a threshold, the likeUhood 
of the activity is predicted for predetermined amounts of time in to the 
future. 

[065] Figure 9 shows the receiver operating characteristic (ROC) curve for 
the method for predicting an activity according to the invention for 1 to 16 
second time lags. 

[066] Although the invention has been described by way of examples of 
preferred embodiments, it is to be understood that various other adaptations 
and modifications can be made within the spirit and scope of the invention. 
Therefore, it is the object of the appended claims to cover all such variations 
and modifications as come within the true spirit and scope of the invention. 
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